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V A GLOSSARY OF MEASUREMENT TERMS USED IN TITLE I EVALUATION 

. Richard 6. Fortna 

Assistant Director ^ 

Region II TAC * * a 

■* * • 

Achievement test — a test designed to measure a person's knowledge skills , 

understandings, etc., in a given field taught in "school. For example, a 

mathematics test or an English test. • -J 

Affective domain test — a test which is designed to measure a person s feelings 
or . emotions • - ^ • 

Age norms — original ly , values representi-hg typical or average pepf o.rmance „ 
fox persons ,of various age groups; *mojsjt Querent usage refers* to sets pf 
complete score interactive data for , appropriate successive age groups. 
Such norms 'are generally used in the interpretation .jbf mental ability test 
scores f • , fc . > ■ - * . m , # . , - 

Atternate-form reliability — the closeness of 'correspondence or .correlation 
between results ori alternate' ( equivalent or parallel); forms of^.a- test.. ^ - • 
The time interval between the*, two testings must- # be relatively* Short a (no * im 
.more than two to three weeks)* so that the examinees- themselves are unchanged, 
in the ability bein'g measured- (See -Reliability coefficient.) 

A'ptitude^ -lL) *a group of « characteristics deemed to be .symptomatic of an 
individual 1 s* ability to acquire proficiency in a given area; examples rnighf b& 
a particular -art school -subject*... or vocational area; (2)^ ability measured by 
the* amount of time required by the learner fo acquire mastery of a task; thus, 
given, enough time all st*udents ¥ can conceivably attain such mastery. 

• * 

Average — the sum of the measures % observations, magnitudes, items or scores m 
'divided by their number, or 'frequency . . 

Basic skills test — a test intended to 'measure fundamental reading and comput- 
ational skills which are the -basis of later learning and - achievement . 
_ . » ... • 

» — * • 

Ceiling — the uppej; limit of ability that c&n be measured by a test. 

Ceiling, effect — (1) the level above which. a £est ceases ttf distinguish 
between actual differences in the ability fteing tested; (2) a situation , 
occurripfe when some members of a group cannot^ score as high as'they are 
capable because the ✓test is too easy. This fe suits in, an artificial 
restriction at *£he r uppeY* end of the score disferibution. -(See Floor effect.) 

•Central tendency (measute o,f) — any of various statistical measures whict\ 
provides a single. most typical value as representative of a group of m measures, 
observations, magnitudes, items pr scores. , (See Average, Median, and Mode.) 

» Chance score — the score that one would expect if an examinee blindly guessed 
on every item. 
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Cpeff icient 'of correlation (r) — a measure of the degree, of • relationship 
between two sets of measures for the same group of individuals. "The ^correla- 
tion coefficient most frequently used in test development and educational 
research is that* known as the Pearson or* product-moment . Correlation coeffi- 
cients range from .00, denoting a complete absence of relationship, .to 
+ r.0CT and to -1.00 indicating, perfect positive or negative correspondence, 
respectively. . | 

Coefficient of stability — £ coefficient of reliability of the type based 
on correlation between test and retest, witfh^an 'intervening period *of time. 
(See Reliability 'coefficient.) + * 

Comparison group model — al'so krvown as Model it is a variation of the, * 
control group design for evaluating "Title I projectg. ' 4 Nfc-tre$tment ex- 
pectation is computed from the c cdmpa^i son ^ro^pjraean* post test* NCE score, ^ 

Compos ite *score — a score whichv combines - sevefcaL scores, usually .by addition; 
ofterv different weights are applied, to the* contributing scores to increase or 
decrease their importance in the resultfng* .composite . r 

Correlation — ('See Coefficient of correlation.) 

Criterion — (1) a standard, norm or judgment selected as a basis for quantitative 
and qualitative comparison; (2) a standard by which a test may be judged or 
evaluated;" a set of scores, ratings, etc., that attest is designed'to measure, . 
predict or correlate v with; (i) a measure or standard, that is used to make 
a judgment about tfre success of • a project or prediction. 

Criterion-referenced iftodel — compares mastery levels achieved onj specif ic^ 
objectives at the end of Early Childhood Education Title* I projects with 
tho^e at the beginning of the project. 

Criterion-referenced test — tests designed t:o assess* performance levels in 
relation to a set of , well-defined objective?. Their scorgs ha#fe. meaning 
in terms -of what the , student knows or can do, rather 'phan, in t^ieir relation to 
the scores made by some external reference group. (See Norm-referenced test.) 

/ : v ; « 

Cutoff score — (See Pnetest cutoff score.)- * * » 

• t \ . . 

>v * tf 

Decile- ^any one of the nine paints (scopes) that divide a distribution" 

into ten parts, each containing one-tenth of .all the scores or cases; every 
tenth percentile. • % ; 

Deviation — the amount by which a score differs from some reference'' value , 
such as the mean, the norm, or the score on some .other test. 

Diagnostic test — a test designed to provide in-depth *informat ion about f , 
specific weaknesses* in a person's reading o.r mathematics* skills ' that must'be % ■ 
remedied before the person can be expected to make normal progress in jtheir 
schoolwork. . * • * 
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Difficulty valuer — an index which indicates^ the percent of some specified 
group, such as students of a given age or grade, "who answer a test, item - 
correctly. * . ^ 

Discrimination power — the ability of a test item to differentiate between 
persons possessing much or little of .some t^rait. . . 

Distra'ctor — any incorrect choice (option^ in a test item;- also called a 

'foil. \ " 1 

% * 

Distribution (Frequency distribution) — a tabulation "of the scores (or other 
attributes) of a group pf individuals to show 'the number (frequency) of each 
score,* or of Jthose within the range of each interval. 

, - • ' * \ " * , . ' ' ' - 

Early childhood education — Educational experiences provided by the schdol 
at the pre-K, K,^ ^and L$t grade levels. t/ 

Empirical ly-normed test — any test which has norms based upon one or more 
of the tfQmmonly accepted methods for assuring a representative sample of 
students or individuals at the grade or age tested. Norms based upon "real 11 
observations. 

, « * V 

Equivalent form — two or more forms of a test which are so similar that 
they can be used interchangeably and 'yet are not identical; two or more 
test forms that yield about the same mean and variability of scores, and 
whose items are similar with respect to type, difficulty, distribution of i 
item-test correlations ' and representative coverage of content. 

Error of measurement — (See Standard error.) * 

" ' , , r ' . . 

Expanded standatd score— a -score system that links tests of different, difficulty 

levels to the same scale; permits out of level testing a,nti conversion to 

in-level norms. 9 \ ' 

* " ' \ ^> . ' 

Extrapolation — the process of inferring values pf a variable in aq unobserved 

interval from values ^within an already observed interval. 

Floor — the lower limit of ability that can be measured by a test. 

Floor 'effect — the level below which a test cease§ to distinguish between " ' 
a-ctual differences in the ability being tested. (See Ceiling effect. ), 

Form — (S£6 Equivalent * form. ) . * 

. 'Frequency distribution — (S£e Distribution.)^ * 

Functional level' testing — testing with an appropriate, difficulty level. °c 
of a test for .the group in question^ avoids floor and ceiling effects; 
.'using a te^t level that distinguishes actual differences in £he- ability 
being' tested. (See In-level test and Out-of-level test*) ' - . 
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t Grade equivalent score — a converted score expressed in terms of a scale 
in which the* grade is a unit of measurement and indicating' the grade. level of 
the group, for which the score is -typical or average; for example, a grade 
equivalent of 6.4 is interpreted as Che fourth month of the sixth grade 
assuming^a 10-month school year. ' * , 

Grade norm — (1) the me&n or median achievement of pupils, in a given school 
s^grade *on a given standardised test; (2) norms based upon the performance of 
pupils of given grade placement. 

Group test — a test that- may be administered to a number of individuals at * 
the same time by .one examine*. o * v 

Halo effect — a positive bias in ratings arising from the tendency of a 
rater to be influenced in the rating of specific traits by the general ■ 
impression of the person being rated. 

Individual .test — a test that can be administered to only one person, at a 
time because of the nature of the test or the maturity level of the examinees 

In-level test — a/ test used P with students in grades which correspond to 
the tests 1 nominal age/grade level. (See Out-of-level test and Functional' 
% level' besting.) . * 

Interpolation — in genetal , any process of estimating intermediate values - 

betyeen two known points; as applied to test norms, refers to the procedure 
ugecUin assigning interpreted values, for example, grade or age equivalents, 

to scores between the successive average scores actually obtained in the 
staqdardizat ic>ri process. ' ' " 

Inventory test — an achievement test? that attempts to cover rather thoroughly 
some relatively sjmall unit of specific instruction or training. 

I tern — a Single question or exercise zn a test*.** 

Item analysis — the process of evaluating single teat items in^respeCt to 
certain 'characteristics. * It usually irtvolves determining the difficulty 
value and the discriminating power of the item, and often its correlation 
with .some external criterion. - ** 

JDRP — the Joint Dissemination Review Panel reviews eviden.ee of effectiveness- 
» .claimed for any educational program* and supports dissemination of those 
found to be exemplary. " » . 

Lej/el — a designation for. a test or tests. in a battery or series suited to 
c a particular 'rank or plane of abifcity or' achievement . In most Achievement 
tests, typically grade in school. ' ' 

* Locator tegt — short 'tests accompanying some test- batteries or series which 
can be used to help determine an appropriate test level <for t the individual 
or group to be tested/ (See Level.) "\ *V 
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Mastery level- -a st^ndarct of performance on criterion-referenced or mastery 
.tests. , • i - * ' . . 0 * 

Mastery tes't: — a test designed to show yhether a student h^s successfully 
performed all the tasks specified in a given ^earning objective , / f • 

Mean — t (See Average.)/ ^» A • 4 

^Median — the .middle score in a distribution or sefof rahked scores; the ■ 
poipt (scot»e) that divides the group j.nto two equ^l parts; the 50th percentile^' 

a measure of central tendency. (See Average and Mode'.) , 

* , * " / 

* i 

Minimum 'competency test — a test -designed to allow an individual to demonstrate 

the acquisition of a skill at the/lowest possible level that is, deemed acceptable. 

* Mode — \\ie score or valu% that occur/s most frequently in a distribution; , 
~a measure of central tendency. (See Average and Median.) „ ; 

Models A,, B, C — (See Norm-referenced model, Compwr'ison ^ro*ip m^del, and* 
Regression model.) , 



)del, Lomaar 

. . 1 



Mu 1 1 i p 1 e-x:li o i G-e i t?en!*-a test item in which tihe examinee's task is td choose 
the Correct Or best answer from several given answers , or options. 

•\ " ■ 1 

— the* symbol ^commonly used to represent the number of cases in a group. , 

Normal curve equivalent (NCE)r -*a normalized, standard-score scale for re- 
porting achievement data referenced , to the national population c at eath grade 
level. The scale has a mean of 50 and a range from 1 to 99.' \ 

Normal distribution — a distribution of scores or measures that in graphic ; 
form has a distinctive bell-shaped appearance; scores or measures are distri- 
buted symmetrically abbut the mean, withes many cases at various distances 
above the mean as at equal distanbes below it and with cases concentrated near 
the mean an4 decreasing in frequency the further one departs from that average, 
according to a precise mathematical equation. 

Norar-referenced model — usually referred to ks Model A, one of the T\tle I 
evaluation models . In this model the treatment effect is defined as the^ 
difference between the treatment group NCE past-test score arid the treatment 
group NCE pretest score. Publishers' national norms are used to estimate 
no-treatment expectation, hence the name norm-referenced model. 

Norm^-referenced test — an examination for which an individual's* score indicates 
•the relationship of the individual's per formance\to that of a t specified norm 
group % 

Norms — statistics, that supply a frame of reference ^y which meaiiing-may 
be given to obtained -test scores. Norms are based upon the actual gerformance 
of pupils of .various grades or ages in the standardisation group ror* the test. 
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Since they represent average or typical performance, they should not be 
regarded as standards or as universally desirable levels of attainment. 

No-treatment expectation — an estimate of what the Title I group posttest 
performance would have been without special instructional intervention. 
(See Project impact. •} 

Objective test —a test made up of items for which correct responses may 
be set up in ^advance; scores are unaffected by the opinion or judgment of 
the scorer. Contrasted with a "sub jective 11 test, such as an essay examination, 
to which different persons may assign different scores, ratings or grades. 

Out of level test — a test used for students in grades either above' or below 
the test's nomrnal age/grade level. When such tests are used they must have 
scares which allow a student's performance to be related to his or her own 
age/grade level. (See Expanded standard scores, Functional level testing 
-and In-fevel t^st.) 

Parent advisory Gouncil — mandated by the law and the regulations, theSe 
advisory groups must be involved in the planning, implementation, and evalua- 
tion of the Title I project. ^ 

Percentile — one of the 99 point scores that divide a ranked distribu- 
tion into groups or parts, each of which contains 1/100 of the scores or 
persons; the po'ints are located to coincide with the obtained scores below 
which in each division -1/100 of the cases fall; thus, a score coinciding 
with the 30th percentile is regarded as equaling or surpassing that of 30 
percent of the persons ir\ the group. "Percentile 11 has nothing~to do with the 
percent of correct answers an examinee makes on £ test. 

Percentile* rank — the expression of an obtained test score in terms of its % 
positiotl within a group* of 100 scores; the percentile rank of a score is 
the percent of scores equal to or lower than the given score in its own 
or, in some external reference group. 

* * 
Performance test — (1) broadly, any test intended to measure actual accomplish- 
ment rather than potential ability br aptitude, regardless of how the subject 
is 'instructed^to respond; (2) a test involving some motor or manual response 
on the examinee's part; usually not a paper-and-pencil test. 

Posttest — a test given at the conclusion of an educational project or treatment 
to determine posFrtreatment s-tatus of the examinee or group in regard to some 
skill, aptitude or J^chievement ." (See Pretest.) 

Power test- ra test intended to treasure level of performance unaffected 
by speed of response; hence, one in which there is either no time limit 
or a very generous one. Items are usually arranged in order of increasing 
•difficulty. > 
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Practice effect — (1) a change that follows practice in taking a test; usually 
an increase in the score af an individual when the same test is taken more* « 
than once"; (2) tlie apparent gain in accomplishment resulting from using tTte 
same test on two or more occasions. 

Pretest--(l) a, test, given in order to determine the status of the examinee 
or group 'in regard to some skill, aptitude, or achievement, as a .basis for 
judging the effectiveness of subsequent treatment; (2) a tryout of some 
test in advance of its regular use. ( See -Posttest . ) 

* * 
Pretest^cutof f score — a score which divides an or iginal inta&t group of 
students into treatment and comparison subgroups (in the Regression model) 
in such a way that all students having pretest scores loyer than the cutoff 
value receive the treatment and all-students scoring ab<*ve the cutoff value 
are excluded from the treatment, 4 

4 

Project impact — difference between actual performance and estimated .no^treat- 
ment posttest performance of Title I group receiving treatment. 

Project vectors — characteristics and 'impact of iTitle I projects at grades 2,6, 
and 10. 

Psychological test — (1) an examination which determines the relative strength 
of intellectual ability in terms of standard; (2) an examination which measurers 
some nonphysical aspect of human behayior. 

Psychomotor test — an examination to measure the -motor effects (e.g.., dexterity, 
physical movement, etc.)*of.a person's mental or cerebral processes. 

Quartile— one of three points that divide the cases in a distribution into 
four equal' groups. The -lower quartile (Ql)> or 25th percentile marks the 
lowest quarter of the group; the middle quartile (Q2) is the same as the 50th N 
percentile or median; and , the third quartile (Q3), or 75.th percentile, sets 
off the top quarter. / 

Rarrcfom^ sample — a sample of the members of some total population selected in 
such a way that every member of the population has an equal chance of being 
"included irf the- sample. • 

Range — for some , specified groyp, the difference between the highest and 
lowest obtained score o^a ' test , thus a very rough measure of spread or ► 
variability. 

Raw score — a quantitative result obtained in scoring a te&t; usually the 
total number of right answers.. „ 

Readiness test — a *est that measures the extent to which an individual 
has achieved a degree of maturity^or acquired certain skills v>r information 
needed for successfully undertaking some new learning activity. Readiness 
Jtests are also classified as prognostic tests. 



Regression effect — tendency of a predicted score to be nearer to the mean 
of its distribution than the score from* which it ts predicted is to its 
mean. Because of the effects of regression, students making extremely % 
high o4f extremely ilow^ scores on a test tend to make less extreme scores, 
i.e., closer to the mean, on a second administration of the same test or 
on some predicted measure . * 

Regression (line) — if two paired lists of numbers, say pretest 'scores and 
posttest scores, are*pfotted in* two dimensions, say pretest horizontally 
and posttest vertically, then there' is exactly one straight* line that can 
be drawn through the plot so that it passes closest- to ^the means of all 
those sets of posttest scores that correspond ,to each pretest score.* "On ' 
fhe average, for'all pretest 'scores , this is the be£t straight-line . fit 
to the observed posttest scores. 

Regression mode^l — also known as Model C, or the spetial regression model. 
In this model the treatment effect is .defined as 'the difference between* 
the treatment group posttest NCE score and the posttest NCE score estimated 

*frdm the comparison group regression line. .* 
« ' * * » 

^ Reliability — the extent to" which a test is consistent in measuring whatever 
it does measure; dependability, stability, trustworthiness, relative freedom 
from errors of measurement, * * _ . - ' . 

Reliability coefficient — the coefficient of correlation between score^on 
two forms of a test, between scores on two administrations "of the same 
test, or betw'een scores on two halves of a' test, properly corrected. ^See 
Alternate form reliability and Coefficient of stability.) 

Reliability, qf classification — parallel forms reliability for criterion- 
referenced tests, determined .by summing the proportion of people classified as 
masters. and nonmasters by both tests. 

» * 

Representative sample — a sample that corresponds to or approaches the popu- 
lation of which' it is a Sample with respect to characteristics important for 
the purposes under investigation. (See Technical standards.) 

Sample— a finite part of a statistical population^ whose properties are' - 
studied to gain information ab9ut the whole. 

Scale — (l) a series of numbers, such as norms, percentile scores, grade 
equivalents, etc., the values of which take significance from' their derivation; 
(2) a test having items arranged in order of difficulty. 

.Significance, statistical — the property of having low probability of occurrence 
on the basis of chance alone, thereby likely occasioned by factors other than 
chance; not necessarily synonymous with practical significance. 

Skewed distribution — a distribution, that departs from symmetry of balance „ 
around' the mean, i.e., from normality. Scores' pile up at one end and trail- 
off at the other. ^ > % 
• * * « 

. " , 10 
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* 

Slope — the inclination or steepness of *a line when it is viewed from left to 
* right, a line's slope is the amount of vertical, rise per.. unit of horizontal run. 

Speeded ^te-st — a form of a test in which performance is ttieasured by the 
^immber of t^sks 'performed in a given time; it* Is assumed that the items 
are uniform in ,dif f iculty ; primarily intended to y^ield a rate score that ■ 
is not affected. by other dimensions of pupil performance. ^ 

* * 
on — a pleasure of the variability or* dispersion of a distjribu- . 



Standards deviati^.. _ ,„____._ — 

tion of i^res. The mor.e the scores cluster around the mean, the smaller the 
standard deviation (§.D.). ; °For a norfnal distribution, about two ( thirds (68.3 
percent). of the scores are within the r>ange from" one S\D. below the mean to' 
'one S.D.. above the mean. . • 

Standard score — a general term referring to any of a varijety of "trans- 
formed 1 / scores, in terms of which raw scores may be expressed for reasons of 
convenience, comparability, ease of interpretation, etc* The 'simplest type o^f 
standard score, known as a Z-score* is an expression of the deviation of a 
score from the' mearv score of 'a group in relation to the standard deviation of 
the scores of the' group.. Thus, . , 



standard score(Z)\- 



raw score(X) - mean(M) . 
^tandird deviation (S.D.) 



Standardized test — a test designed to provide a systematic sample of individual 
performance, administered according -to prescribed directions, scored in 
conformance with definite rules, and interpreted in reference to certain 
normative information. Other restrictions include^ those whose items have N been J" 
chosen on the basis'o'f experimental evaluation, and for which data on'reli- 
•ability arid validity are* provided . Others' add "commercially published J- 1 

Stanine — one of -tHe'" steps in a nine-point scale of standard scores. The ^ - 
stanine (short, for st v andard-nine)* scale has values from 1 po 9. Each stanine 
(except 1 and 9) is 1/2 S.D. in width. ■ 

Survey test — a test that me^surfes- general achievement in a' given area, j 
usually with the connotation that the. test is intended to 'assess group ( 
status, rather than to yield precise measures' of individual per f ormancerT 

Sustained gain — measurement to determine whether the student achievement 
fostered through Title I service is continued beyoned the end of the Title I 
prqject, that is, at lea^t 12 roontJiSL ^fter Jthe pretest. 

Technical standards— mandated standards for evaluation of Title I project* 
effectiveness. LEA must explain in its application how-its evaluation 
will be consistent with these standards. They are: (1) representativeness 
of evaluation findings; (2) reliability and validity \of evaluation instruments 
and procedures; (3) procedures which -will minimize error; and (4), valid - « 
assessment of achievement gains in reading! mathematics and language arts. 
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' TIERS — acronym for the Title j[ Evaluation" and Reporting System.. 

, o 

True score — a. score -entirely. fre£ o,f. error; hence, .a hypothetical value 
that cap never be obtainU" by testing, which always involves some Measurement • 
"error. A "true' 1 ' score may be thought of as. the average score from an "infinite 
number of measurements from the same.pr ex£ctly # equivalent -tests , assuming no 
» practice effect or change in the individual during the tastings.- 

Tyfrg I error — rejecting^as false a statement or condition which is true. 

i lr • ' 

N Typ'e II. error — not accepting a true difference in^ condition, as true. 

Validity- ;-the ext^ftt to which a % test 'does ' the job for which -(t is used. 
Generally -classified into Jour types: ' - K • ' 

' . " " • '* > ' - ' * - /' 

Face validity — extent to which a-test appeals to n^sure what.it is 

^ intended to measure. * ,* ' ' 

* Content-validity^ — the extent to which ^the content o % f an achievement 'test 
represents a balanced and adequate sampling of the universe of Qontent in 

" which the' test is intended to measure achievement . , It? is besty evidenced 
by a comparison of the. test content .with courses of 'study ,' instructional 
materials, ^hd statement's \of instructional goajs. 

" ' ' - * * 53 . . * 

^ Predictive vabidity — the extent to whicbTa test "accurately indicates 
x 'future learning suctress in" £he area for* why: h it i^ used as a predictor. * 
•Evidence of predictive validity is shoyn by. correlations between scores . 
qn the test .and* f uture-^cr iterio^i measures o£. success. High school 
^titude^'test' scores highly correlatedf with first year coVlege grpde 
^ point averages* is on'e'examp^^f predictive -validity . 

"f^4>* * " » * * . ^ * < ^ - * ^ ^ 

.Concurrent Valid ity- -:the extent *to whic^ scores on a test are in agreement: 
wifc^some given criterioh measure, t There is usually no -significant ' time * 
interval ia[pse between the time the test*, scores and criterion measures 

* ' are obtained. For example, teacher 1 ratings of reading ability made at 

ab^out the # same time as the postte^J: is administered could be correlated 
to obtain an index>^f cor&urrent validity* -~ 4 . 

K ' ' • • < \ . : 

Validity, coefficient — the coefficient ftf correlat ion^between a criterion . • 
variable and one or ipore independent variables that purport t<vmeasure . 
or are used 'to predict the criterion. ' / 

V^lue added model — uses % the' f elationshipr between .test £<pore ^and age ^and^he 
information it -contains about natural growth to project a "nd-treatment" , 
.expectation for Early Childhood Education Title I, project participants. (See 
Criterion-referenced .model . ) " ' • 4 

Variance — a measure ^|f variability equal to the, square of the standard, 
deviation; the average of the squared deviations from thfe mean. K » • 

Weighted mean— ^n average of a list of averages or means 'that takes into 
account <the number of cases th^t entered the -computation of each average. 
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